Interactive graphic rendering method and apparatus, and computer storage medium

ABSTRACT

An apparatus may obtain, by a processor, target object data formatted based on a first format. The target object data may include a plurality of element resources for a three dimensional model. The first format comprising a file format for transmission of three-dimensional model data. The apparatus may obtain, by the processor, configuration information associated with the target object data. The apparatus may generate, by the processor, a data packet of a second format based on the target object data and the configuration information. The apparatus may provide, by the processor, the data packet to a terminal device.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a divisional of co-pending U.S. Non-Provisionalapplication Ser. No. 16/555,345, filed Aug. 29, 2019, which is acontinuation of International Application No. PCT/CN2018/100313, filedAug. 14, 2018, entitled INFORMATION PROCESSING METHOD AND APPARATUS, ANDCOMPUTER STORAGE MEDIUM, which claims priority to Chinese PatentApplication No. 201710697757.4, filed on Aug. 15, 2017. The contents ofU.S. Non-Provisional application Ser. No. 16/555,345, InternationalApplication No. PCT/CN2018/100313, and Chinese Patent Application No.201710697757.4 are each incorporated herein by reference in theirentirety.

TECHNICAL FIELD

This application relates to computer rendering, and specifically, tocomputer rendering of interactive objects.

BACKGROUND

With the rapid development of Internet applications, variousapplications come forth. A object visible in an application (forexample, an avatar rendering in the application) is usually atwo-dimensional object. Development of three dimensional visual data andapplications often require separate skills and technical expertise.Applications with integrated three-dimensional data is integrated may islong and resource intensive.

SUMMARY

Aspects of the present disclosure provide various methods andapparatuses, and computer storage mediums, and systems By way ofintroductory example, a first aspect of the present disclosure mayinclude a computer-implemented method, such as a method implemented by aserver. The method may include obtaining, by a processor, target objectdata formatted based on a first format. The target object data mayinclude a plurality of element resources for a three dimensional model.The first format may include a file format for transmission ofthree-dimensional model data. The method may further include obtaining,by the processor, configuration information associated with the targetobject data. The method may further include generating, by theprocessor, a data packet of a second format based on the target objectdata and the configuration information. The method may further includeproviding, by the processor, the data packet to a terminal device. Themethod may further include obtaining configuration informationassociated with the target object data. The method may further includegenerating a data packet of a second format based on the target objectdata and the configuration information. The method may further includeproviding the data packet to a terminal device.

A second aspect of the present disclosure may include acomputer-implemented method, such as a method implemented by a terminaldevice. The method may include drawing, by the terminal device, a firstimage layer corresponding to an application program. The method mayfurther include calling, by the terminal device, a first data packetconcurrent with execution of a running instruction of an applicationprogram. The method may further include drawing, by the terminal device,concurrent with execution of the application program and drawing of thefirst image layer corresponding to the application program, a secondimage layer comprising a target object based on the first data packetand a preset display attribute, the preset display attribute positionedin the second image layer separate from the target object in the secondimage layer. The method may further include rendering, by the terminaldevice, image data comprising the first image layer and the second imagelayer, the second image layer covering the first image layer. The methodmay further include detecting, by the terminal device, a first operationevent for the target object. The method may further include executing,by the terminal device, a first operation instruction included in thefirst data packet to cause the target object to move.

A third aspect of the present disclosure may include a non-transitorycomputer readable storage medium. The non-transitory computer readablestorage medium may include instructions executable by a processor. Theinstruction may cause the processor to obtain target object dataformatted based on a first format, the target object data comprising aplurality of element resources for a three dimensional model, the firstformat being a file format for transmission of three-dimensional modeldata. The instructions may further cause the processor to obtainconfiguration information associated with the target object data. Theinstructions may further cause the processor to generate a data packetof a second format based on the target object data and the configurationinformation. The instructions may further cause the processor to providethe data packet to a terminal device.

Additional or alternative aspects are provided in the presentdisclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments may be better understood with reference to the followingdrawings and description. The components in the figures are notnecessarily to scale. Moreover, in the figures, like-referenced numeralsdesignate corresponding parts throughout the different views.

FIG. 1a is a schematic flowchart of an information processing methodaccording to an embodiment of this application.

FIG. 1b is a schematic flowchart of an information processing methodaccording to an embodiment of this application.

FIG. 1c is a schematic diagram of an information processing apparatusaccording to an embodiment of this application.

FIG. 2 is a schematic diagram of an application architecture of aninformation processing method according to an embodiment of thisapplication.

FIG. 3a to FIG. 3d are respectively schematic diagrams of an applicationscenario of an information processing method according to an embodimentof this application.

FIG. 4 is a first schematic flowchart of an information processingmethod according to an embodiment of this application.

FIG. 5 is a second schematic flowchart of an information processingmethod according to an embodiment of this application.

FIG. 6 is a fourth schematic flowchart of an information processingmethod according to an embodiment of this application.

FIG. 7 is a schematic diagram of interaction of an informationprocessing method according to an embodiment of this application.

FIG. 8 is another schematic diagram of interaction of an informationprocessing method according to an embodiment of this application.

FIG. 9 is a first schematic structural diagram of an informationprocessing apparatus according to an embodiment of this application.

FIG. 10 is a second schematic structural diagram of an informationprocessing apparatus according to an embodiment of this application.

FIG. 11 is a schematic diagram of hardware composition of an informationprocessing apparatus according to an embodiment of this application.

FIG. 12 is a schematic structural diagram of an information processingapparatus according to an embodiment of this application.

FIG. 13 is a third schematic structural diagram of an informationprocessing apparatus according to an embodiment of this application.

DETAILED DESCRIPTION

A target object in an existing application (the target object is, forexample, an avatar in the application) is usually a two-dimensionalobject, and a three-dimensional object rarely occurs. This is becauseapplication development and three-dimensional object development areseparately used as an independent development category, and each needscorresponding development conditions and development skills, and arequirement that has both the two development conditions and developmentskills is relatively high, the development is difficult, and thedevelopment period is long.

An example of a technical advancement achieved by the systems, methods,and devices described herein is that a three-dimensional modelmanufacturer may develop and manufacture a data packet for a user toobtain and call, without the user having advanced development expertiseto integrate a target object with the display content of an applicationprogram. The data packet, being developed by a professionalthree-dimensional model developer, may generate and cause the targetobject to be displayed. The data packet may further cause changes to thedisplayed object in response to interactive input. Thus, the developmentthreshold for integrating interactive three-dimensional content withapplications is significantly reduce.

FIG. 1a is a schematic flowchart of an information processing methodaccording to an embodiment of this application. The method may beexecuted by a computing device. The computing device may be a terminaldevice, or a device in a platform that provides a particular onlineservice, such as a server. As shown in FIG. 1a , the method may includethe following steps.

Step 10: Obtain target object data of a first format, and obtainconfiguration information of the target object data.

The target object is a three-dimensional model, the target object dataincludes data of a plurality of element resources, and the first formatis a file format supporting transmission of three-dimensional modeldata.

Step 20: Generate a data packet of a second format based on the targetobject data and the configuration information, and provide the datapacket to a terminal device.

In each embodiment, the element resources may be components thatconstitute the target object. When the target object is an avatarobject, the element resources may include body, portions of a body,hair, clothes, and the like that constitute the avatar object, and aredenoted as body element resources, hair element resources, clotheselement resources, and the like.

In each embodiment, the first format is any file format supportingtransmission of three-dimensional model data, for example, a DAE format,an FBX format, or an OBJ format.

In each embodiment, the configuration information of the target objectdata may include one type of the following information: the number andformats of target objects; version information, and data set for acustomization requirement of the target object (such as a customizableattribute of each element of the three-dimensional model).

The first data packet further includes information such as a file type,a user identity, a time parameter, and a version identifier.

In some embodiments, when the computing device is a terminal device,some of the plurality of element resources may be generated throughmanufacturing by a person operating the terminal device, and some of theelement resources may be obtained from a device in a platform of theonline service. For example, the online service platform may provide aplurality of body element resources, hair element resources, clotheselement resources, and the like, for the terminal device to select anddownload. In some embodiments, the terminal device may obtain variousconfiguration information through a user interface, to generate a datapacket, and provides the data packet to the online service platform, andthe online service platform provides the data packet to another terminaldevice. FIG. 1b is a schematic flowchart of an information processingmethod according to an embodiment of this application. The method may beapplied to the terminal device. The terminal device may be specificallya first type of terminal shown in FIG. 2. As shown in FIG. 1b , themethod may include the following steps.

Step 301: Obtain the target object data of the first format based on theplurality of element resources, and obtain the configuration informationof the target object data, the first format being any file formatsupporting transmission of specific data.

Step 302: Generate a first data packet meeting a specific format basedon the target object data and the configuration information, send thefirst data packet to a network device, so that the terminal deviceobtains the first data packet from the network device.

In some other embodiments, when the computing device is a device in anonline service platform (online service platform for short below), theterminal device may access the online service platform, select elementresources from element resources provided by the online serviceplatform, and/or upload element resources generated throughmanufacturing by an operator of the terminal device, and call anoperation interface provided by the online service platform to generatea target object, and provide the configuration information to the onlineservice platform. The online service platform obtains the elementresources selected and/or uploaded by the terminal device and theconfiguration information, and generates a data packet by using theelement resources and the configuration information, and provides thedata packet to another terminal device.

In each embodiment, a plurality of preset standard element resources maybe obtained, the standard element resources meeting the first format;updating configuration is performed on at least some of the plurality ofstandard element resources, to obtain a plurality of element resourcesmeeting a requirement; and the target object data of the first format isobtained based on the plurality of element resources. For example, aplurality of standard element resources may be preset in the onlineservice platform, and the standard element resources may be used aselement resources in an initial state. Based on the standard elementresources, a developer may perform updating configuration to modify thestandard element resources, for example, modify attribute informationsuch as the color and type of the hair element resources, the clotheselement resources, and the accessory element resources, or modifyattribute information of whole element resources after a combination ofbody, hair, clothes, and accessories.

According to each embodiment, the data packet is developed andmanufactured by a professional three-dimensional model manufacturer andprovided to a terminal device of a user, and the user does not need tomaster a development principle of the three-dimensional model, so thatthe development threshold and development costs of the applicationprogram using a three-dimensional model are greatly reduced.

To reduce a development threshold of the application program using athree-dimensional model for rendering the three-dimensional model, ineach embodiment, a rendering logic may be encapsulated in the datapacket. The rendering logic may be configured to: in response to a callinstruction for the data packet, obtain a rendering parameter from thecall instruction, render an image layer including the target object, andset an attribute value of the target object in the image layer to avalue in the rendering parameter.

To further reduce a development threshold of the application programusing a three-dimensional model for operating the three-dimensionalmodel, in each embodiment, an interaction logic may be encapsulated inthe data packet. The interaction logic may be configured to: in responseto an operation event for the target object rendered in the image layer,obtain an operation parameter from the operation event, and execute anoperation corresponding to the operation parameter on the target objectrendered in the image layer.

In each embodiment, the data packet may be encapsulated into a form of asoftware development kit (SDK). Data packets of different SDK versionsmay be generated for different platforms (for example, a Windowsplatform and an IOS platform). The data packet provides external callinterfaces, so that an external program can call, through the externalcall interfaces, processing operations encapsulated in the data packet,for example, a rendering function provided by the rendering logic and a3D model operating function provided by the interaction logic. In thisway, after the data packet is provided to the developer of theapplication program, the developer may add, to the application program,instruction data for calling the data packet, and provides the datapacket and the application program to the terminal device. When theterminal device runs the application program, the application programmay call the data packet according to a running logic thereof.

For example, attribute values of the target object in the image layermay include the size of the target size, the location and theorientation of the target object in the image layer, and the like. Whenthe application program calls the rendering logic in the data packet,needed information such as the size value, location coordinate values,and orientation of the target object is transmitted to the renderinglogic through a call instruction. The rendering logic obtains therendering parameters from the call instruction, sets correspondingattribute values of the target model, and renders the set target modelin the image layer displayed on the screen of the terminal device.

For another example, the user or the application program of the terminaldevice may operate the target model displayed in the terminal device.For example, when detecting a screen touch operation of the user, theoperating system of the terminal device may use a parameter of thescreen touch operation as an operation parameter and transmit theoperation parameter to the interaction logic in the data packet throughan operation instruction; or, when detecting that a preset triggercondition is met, the application program generates an operationparameter corresponding to the trigger condition, and transmits theoperation parameter to the interaction logic in the data packet throughthe operation instruction. The operation parameter may include but isnot limited to: the location of the screen touch operation, the actiontype of the screen touch operation, the size value of the target model,the moving direction and moving distance of the target model, therotation direction and rotation angle of the target model, an operatedelement and operation type in the target model, and the like. Theinteraction logic obtains the operation parameters from the operationinstruction, and executes an operation corresponding to the operationparameter on the target model displayed in the terminal device, forexample, modifies the size of the target model, makes the target modelmove or rotate, or modifies an attribute value of an element of thetarget model.

Each embodiment further provides an information processing apparatus.The apparatus may include an obtaining circuitry and an encapsulationcircuitry.

The obtaining circuitry is configured to: obtain target object data of afirst format, and obtain configuration information of the target objectdata, the target object being a three-dimensional model, the targetobject data including data of a plurality of element resources, and thefirst format being a file format supporting transmission ofthree-dimensional model data.

The encapsulation circuitry generates a data packet of a second formatbased on the target object data and the configuration information, andprovides the data packet to a terminal device.

In each embodiment, the encapsulation circuitry may further encapsulatethe rendering logic and/or interaction logic in the data packet.

FIG. 1c is a schematic diagram of an information processing apparatusaccording to an embodiment of this application. As shown in FIG. 1c ,the apparatus may include a processor 40, a memory 30, and a networkinterface 50.

The network interface 50 may enable, by using a communication protocol,the apparatus to communicate with another device in a network.

The processor 40 may be one or more processors disposed in one or morecomputing devices. The processor 40 may execute a computer readableinstruction in the memory 30, to complete an operation corresponding tothe instruction.

The memory 30 may be one or more memories disposed in one or morecomputing devices. The memory 30 may include an operating system 60, anetwork communication logic 70, and an information processing logic 80.

The information processing logic 80 may include a rendering logic 81and/or an interaction logic 82.

FIG. 2 is a schematic diagram of an application architecture of aninformation processing method according to an embodiment of thisapplication. As shown in FIG. 2, the application architecture includes aserver 11, terminals 21 to 24, and terminals 31 and 32. The terminals 21to 24 may perform information interaction with the server 11 in a mannerof a wired network or a wireless network. Correspondingly, the terminals31 and 32 may also perform information interaction with the server 11 ina manner of a wired network or a wireless network. The terminals 31 and32 may be referred to as a first type of terminal, or may be referred toas a model generation end, and the terminals 21 to 24 may be referred toas a second type of terminal, or may be referred to as a model use end.

On the model generation end, a model developer may manufacture a modelobject through the terminal device shown by the terminals 31 and 32, togenerate a data packet including a model object and fused with aspecific application program, and send the data packet to the server 11.As a data open platform, the server 11 may provide data including amodel object to the user. The user may obtain, through the terminals 21to 24 as the model use end from the server 11, a data packet thatincludes a model object and that meets a requirement thereof. When thespecific application program is run in the terminal that obtains thedata packet, the data packet is also run. When the first image layercorresponding to display content of the specific application program isrendered, the second image layer including the model object is rendered,and the second image layer covers the first image layer in an embeddingmanner, so that when the image data is output, the model object has aspecific display effect on the display content of the specificapplication program, and when the model object is a 3D model object,there is a display effect of a three-dimensional object. In addition,the data packet is fused with the specific application program, namely,when the specific application program starts to run, the data packet isalso run.

The terminal device (including terminals 21 to 24 and terminals 31 and32) may be implemented through terminal devices of types such as amobile phone, a tablet computer, a personal computer (PC), and anall-in-one machine. The terminals 31 and 32 have digital file inputcapabilities, namely, have three-dimensional model data manufacturingand inputting operations.

The server 11 may be used as a server to which the data open platformbelongs. The data open platform may be specifically output through aspecific webpage or a specific application and is browsed by a terminaluser. In an implementation, the data open platform may be presented in aform of an “electronic market” (the “electronic market” is, for example,an APP STORE application in the IOS operating system, or an applicationdownloading platform such as an Android market in the Android operatingsystem). For example, a data packet (the data packet may include aplurality of types, and data of a corresponding target object may bepreconfigured in each type of data packet, and the first data packet maybe one of the plurality of types of data packets) may be presented in anapplication downloading platform in a form of “commodity”. A user maysearch for a required data packet in the application downloadingplatform and performs downloading to obtain the data packet. Whenneeded, if the data packet does not support free downloading, the userfurther needs to pay some fees to download and obtain the correspondingdata packet.

The type of the specific application program may include: anyapplication program having a three-dimensional model data requirementsuch as a map type application or a game type application. FIG. 3a toFIG. 3d are respectively schematic diagrams of an application scenarioof an information processing method according to an embodiment of thisapplication. In an example, for example, the specific applicationprogram is a map type application. Referring to FIG. 3a and FIG. 3b ,for example, in FIG. 3a , an application scenario in which the map typeapplication outputs and displays a live view of the location is run, andfor another example, an application scenario in which the map typeapplication performs navigation is run. In another example, for example,the specific application program is a map type application. Referring toFIG. 3c and FIG. 3d , an application scenario in which a game typeapplication performs virtual game and virtual socialization is run. Inthe application scenario shown in FIG. 3a to FIG. 3d , a second imagelayer including a three-dimensional object may be rendered through theinformation processing method of this embodiment of this application,and the second image layer is covered on a first image layercorresponding to display content of the application program.

The example shown in FIG. 2 is merely a system architecture example thatimplements this embodiment of this application. This embodiment of thisapplication is not limited to the system structure of FIG. 2. Based onthe system architecture, various embodiments of this application areprovided. Correspondingly, examples shown in FIG. 3a to FIG. 3d aremerely several application examples of this embodiment of thisapplication. The information processing scheme of this embodiment ofthis application is not limited to application to the severalapplication examples.

An embodiment of this application provides an information processingmethod, applied to a terminal device. The terminal device may be asecond type of terminal shown in FIG. 2. FIG. 4 is a first schematicflowchart of an information processing method according to an embodimentof this application. As shown in FIG. 4, the method includes:

Step 101: Call and load a pre-obtained first data packet duringexecution of a running instruction of an application program.

Step 102: Draw a second image layer including a target object based onthe loading of the first data packet during running of the applicationprogram and drawing of a first image layer corresponding to theapplication program, a specific display attribute being configured inareas other than the target object in the second image layer.

Step 103: Render and output image data including the first image layerand the second image layer, the second image layer covering the firstimage layer.

Step 104: If an operation is detected, when the operation is a firstoperation for the target object, generate and execute a first operationinstruction based on the first data packet to control the target objectto execute a corresponding action.

In this embodiment, the calling and loading a pre-obtained first datapacket during execution of a running instruction of an applicationprogram includes: when an operation of an icon corresponding to theapplication program is detected, generating and executing the runninginstruction of the application program, to run the application program;or, when it is detected that the application program switches from abackground running status to a front end running status, generating andexecuting the running instruction of the application program, to run theapplication program on the front end, the background running statusindicating a status in running but not displaying running, and the frontend running status indicating a status in running and displayingrunning. Namely, in this embodiment, when the application program isactivated to run, or switches from background running to front endrunning, a pre-obtained first data packet is called and loaded.

The first data packet may be pre-obtained by the terminal device in amanner of a wired data connection or wireless communication. In anexample, the terminal device may obtain, in a manner of a wired dataconnection, the first data packet sent by the computer device (such asanother terminal device). In another example, the terminal device maydownload the first data packet from the server 11 shown in FIG. 2 in awireless communication manner. The first data packet may be encapsulatedin a form of an SDK.

In this embodiment, when the application program is run and the firstimage layer corresponding to display content of the application programis drawn, a second image layer including a target object is drawn basedon the run first data packet, target object data being preconfigured inthe first data packet. The first data packet may include at least onepiece of target object data. Namely, when the second image layerincluding the target object is drawn, the number of target objects inthe second image layer may be at least one. During actual application,the second image layer may be rendered in a manner of an open graphicslibrary (OpenGL), so that the second image layer has a specific displayattribute. The specific display attribute is, for example, a transparentbackground and foreground customizable content, namely, a foregroundcustomization target object. Areas other than the target object are setto a transparent display attribute, so that when the second image layercovers the first image layer, the target object is presented and fusedin display content of the application program, and areas other than thearea covered by the target object in the display content of theapplication program can be browsed by a user through the first imagelayer in the transparent display attribute.

The first data packet includes target object data. The target objectdata is used to draw a corresponding target object during running of thefirst data packet. The target object may be specifically athree-dimensional object. Namely, after the second image layer isrendered, a user may see a target object having a three-dimensionaleffect.

In this embodiment, when image data is rendered and output, the secondimage layer is covered on the first image layer, and a combined imagelayer is rendered as image data and is output. During actualapplication, a to-be-output image may include a plurality of layersduring image drawing. Each layer may include different elements in theimage. For example, an image layer including background image data maybe disposed on a bottom image layer, and other elements other than thebackground image data in the image data may be disposed on other imagelayers other than a top image layer and the bottom image layer accordingto an actual requirement. The second image layer in this embodiment maybe disposed on a top layer. The first image layer in this embodiment mayinclude other image layers other than the top image layer. Aconfiguration parameter of each image layer may be configured. Alocation of each image layer in all image layers may be determined basedon the configuration parameter. In an actual drawing process, relativelayer locations of the image layers may be formatted based onconfiguration parameters carried in the image layers, and then imagedata in the image layer is drawn.

In this embodiment, the detecting an operation includes: detecting ascreen operation based on a touch sensing assembly, or detecting aninput operation based on an input assembly. The input assembly includesat least one of the following: a physical key, a built-in keyboard, anexternal keyboard, a mouse, and other data input devices. In animplementation, when the terminal device is a terminal device of a typesuch as a mobile phone or a tablet computer having a touch sensingscreen, a screen operation may be detected through the touch sensingscreen. In another implementation, when the terminal device is aterminal device of a type such as a mobile phone having a physical keyor a computer having a keyboard and/or a mouse, an input operation maybe detected through a data input device such as a physical key, akeyboard, or a mouse. Further, determining whether the operation is thefirst operation for the target object includes: obtaining locationinformation of the operation, and obtaining relative locationinformation of the target object; and calculating an offset distancebetween the location information and the relative location information,and determining that the operation is the first operation for the targetobject when the offset distance does not reach a preset threshold.

In an implementation, when a screen operation is detected, it isdetected whether the screen operation is a first operation for thetarget object. Target object data corresponding to the target objectincludes relative location information. The relative locationinformation may represent a location of the current target object in adisplay screen. During actual application, the relative locationinformation may be indicated through coordinate information in which thedisplay screen is a coordinate plane. An operation location of thescreen operation is detected through a touch sensing assembly, and iscompared with the relative location information of the target object forcalculation, to obtain an offset distance between the operation locationand the relative location information. When the offset distance does notreach a preset threshold, it may be determined that the operationlocation matches the relative location information, namely, it isdetermined that the screen operation is for the target object, and it isdetected that the screen operation is the first operation for the targetobject. During actual application, based on the second image layerlocated on the top layer, the screen operation may be detected by thefirst data packet, and it is determined whether the screen operation isthe first operation for the target object. In other implementations, thescreen operation may also be detected by an operating system, and theoperating system determines whether the screen operation is the firstoperation for the target object.

In another implementation, when an input operation is detected, it isdetected whether the input operation is a first operation for the targetobject. After the first data packet is loaded, an input interface thatcan receive a view layer is provided. An input operation of a data inputdevice may be first detected by the view layer, and location informationof the input operation in the view layer is obtained. Locationinformation of the input operation in the view layer is obtained throughthe input interface provided after the first data packet is loaded.Target object data corresponding to the target object includes relativelocation information. The relative location information may represent alocation of the current target object in a display screen. During actualapplication, the relative location information may be indicated throughcoordinate information in which a display screen is a coordinate plane.The location information of the input operation in the view layer iscompared with the relative location information of the target object forcalculation, to obtain an offset distance between the locationinformation of the input operation in the view layer and the relativelocation information. When the offset distance does not reach a presetthreshold, it may be determined that the location information of theinput operation in the view layer matches the relative locationinformation, namely, it is determined that the input operation is forthe target object, and it is detected that the input operation is thefirst operation for the target object.

In this embodiment, when it is determined that the operation is thefirst operation for the target object, a first operation instruction isgenerated and executed based on the first data packet. In animplementation, when the operating system detects the first operation, atarget object event corresponding to the first operation is generatedand the first data packet is notified. In another implementation, basedon the second image layer located on the top layer, the first datapacket may directly detect the first operation. At least one group ofoperations and corresponding operation instructions are preconfigured inthe first data packet. When the first operation is detected, namely,when a target object event corresponding to the first operation isreceived, the first operation instruction corresponding to the firstoperation is obtained and executed. The first operation instruction isused to control the target object to execute a corresponding action. Theaction is, for example, an action such as movement or jumping. When thetarget object is presented as a three-dimensional avatar object, theaction may also be an action that controls four limbs of thethree-dimensional avatar object, and/or, that controls facial expressionchanges of the three-dimensional avatar object. When the operatingsystem generates a target object event corresponding to the firstoperation and notifies the first data packet, a processing statusnotification is sent to the application program, and the processingstatus notification is used to notify the application program of thecurrent processing process.

In this embodiment, when the run application program is a map typeapplication program, reference may be made to FIG. 3a and FIG. 3b for aspecific application scenario. FIG. 3a shows a scenario in which athree-dimensional map display function in the map type applicationprogram is activated. In this scenario, the pre-obtained first datapacket is called and loaded, to implement display of the virtualthree-dimensional avatar object shown in FIG. 3a included in the firstdata packet in the three-dimensional map. When an operation is performedfor the virtual three-dimensional avatar object, the virtualthree-dimensional avatar object may execute a corresponding action suchas advancing, retreating, or jumping based on the operation. When anoperation is formed for a background (the virtual three-dimensionalavatar may be used as a foreground, and the displayed three-dimensionalmap may be used as a background) other than the virtualthree-dimensional avatar object, the map type application executes acorresponding instruction for the operation. The instruction is, forexample, viewing detailed information of a location in athree-dimensional map, location searching, or route searching. FIG. 3bmay show a scenario in which a navigation function in the map typeapplication program (in an example, the navigation function may bespecifically a walking navigation function) is activated. In thisscenario, the pre-obtained first data packet is called and loaded, toimplement display of the virtual three-dimensional avatar object shownin FIG. 3b included in the first data packet at a start location of anavigation interface. When a navigation operation is executed, thevirtual three-dimensional avatar object may move based on a navigationroute.

In another scenario example, FIG. 3c shows a scenario in which the runapplication program is a game type application program. FIG. 3c may showa game type application including a virtual three-dimensional avatarobject. The pre-obtained first data packet is called and loaded, toimplement display of the virtual three-dimensional avatar object shownin FIG. 3c included in the first data packet in a game interface as abackground. In an example, the virtual three-dimensional avatar objectmay execute an action such as advancing, retreating, or jumping based onthe operation for the virtual three-dimensional avatar object. Inanother example, the virtual three-dimensional avatar object may alsochange the appearance (for example, change clothes, hairstyle,accessories, or makeup) of the virtual three-dimensional avatar objectin combination with an operation detected by the game application.

By using the technical solution of this embodiment of this application,the obtained first data packet is loaded during running of theapplication program, and the second image layer that includes the targetobject and that is drawn based on the loading of the first data packetis covered on the first image layer drawn based on the running of theapplication program, so that a display effect that the target object isfused with the display content of the application program isimplemented. In addition, the fused display content supports useroperations, thereby implementing smooth communication between the targetobject and the display content of the application program. On the otherhand, the first data packet is independent of the application program,so that the first data packet can be developed by a dedicateddevelopment group, and a user does not need to learn a developmentprinciple of the target object, and the target object fused with thedisplay content of the application program can be obtained by obtainingthe first data packet from the network device. The first data packet isdeveloped by a professional developer of the target object, so that thedevelopment threshold and development costs are greatly reduced, anddevelopment time is reduced.

Based on the foregoing embodiment, FIG. 5 is a second schematicflowchart of an information processing method according to an embodimentof this application. As shown in FIG. 5, based on the foregoingembodiment, the information processing method of this embodiment of thisapplication further includes:

Step 105: When the operation is a second operation for a virtual objectother than the target object, generate and execute a second operationinstruction based on the application program to respond to theapplication program.

In this implementation, when it is determined that the operation is asecond operation for other virtual objects other than the target object,namely, the operation is not for the target object, namely, areas otherthan the target object in the first image layer have a transparentdisplay attribute, so that the operation is for the virtual objectincluded in the application program rendered in the first image layer,in an implementation, the operating system detects the second operation,and an application program event corresponding to the second operationis generated based on an identification result that the second operationis not for the target object, and the application program event isnotified to the application program. In another implementation, thefirst data packet detects a second operation, and an application programevent corresponding to the second operation is generated based on anidentification result that the second operation is not for the targetobject, and the application program event is notified to the applicationprogram, so that the application program generates and executes a secondoperation instruction according to the application program event of thesecond operation, and the second operation instruction is used torespond to the application program. In this way, smooth communicationbetween the target object and the display content of the applicationprogram is implemented, and seamless fusion between the first datapacket and the application program is also implemented.

An embodiment of this application further provides an informationprocessing method. FIG. 6 is a third schematic flowchart of aninformation processing method according to an embodiment of thisapplication. As shown in FIG. 6, the method includes:

Step 201: Call and load a pre-obtained first data packet duringexecution of a running instruction of an application program.

Step 202: Obtain at least one second user identity associated with afirst user identity corresponding to the application program; and call aspecific interface to obtain target object data corresponding to the atleast one second user identity.

Step 203: Draw a second image layer including a first target object anda second target object based on loading of the first data and the targetobject data of the at least one second user identity during running ofthe application program and drawing of a first image layer correspondingto the application program, the first target object corresponding to thefirst user identity, and the second target object corresponding to thesecond user identity, and a specific display attribute being configuredin areas other than the first target object and the second target objectin the second image layer.

Step 204: Render and output image data including the first image layerand the second image layer, the second image layer covering the firstimage layer.

Step 205: If an operation is detected, when the operation is a firstoperation for the first target object, generate and execute a firstoperation instruction based on the first data packet to control thefirst target object to execute a corresponding action.

In this embodiment, the calling and loading a pre-obtained first datapacket during execution of a running instruction of an applicationprogram includes: when an operation of an icon corresponding to theapplication program is detected, generating and executing the runninginstruction of the application program, to run the application program;or, when it is detected that the application program switches from abackground running status to a front end running status, generating andexecuting the running instruction of the application program, to run theapplication program on the front end, the background running statusindicating a status in running but not displaying running, and the frontend running status indicating a status in running and displayingrunning. Namely, in this embodiment, when the application program isactivated to run, or switches from background running to front endrunning, a pre-obtained first data packet is called and loaded.

The first data packet may be pre-obtained by the terminal device in amanner of a wired data connection or wireless communication. In anexample, the terminal device may obtain, in a manner of a wired dataconnection, the first data packet sent by the computer device (such asanother terminal device). In another example, the terminal device maydownload the first data packet from the server 11 shown in FIG. 2 in awireless communication manner. The first data packet may be encapsulatedin a form of an SDK.

In this embodiment, after the pre-obtained first data packet is calledand loaded, at least one second user identity associated with the firstuser identity corresponding to the application program is obtained. Thefirst user identity may be specifically indicated by a user account ofthe application program. When the application program needs to beregistered and logged, the first user identity may be a user accountafter the user performs registration based on the application program.The first user identity may also be specifically a terminal identifierof the terminal to which the application program belongs. When theapplication program can be used without registration, the first useridentity can be indicated by the terminal identifier of the terminal towhich the application program belongs, and there may be a one-to-onecorrespondence between the terminal identifier and the terminal.

The at least one second user identity has a specific association withthe first user identity. The specific association may be specifically adirect association or an indirect association. The direct association isspecifically that user associated data corresponding to the first useridentity includes at least one second user identity, for example, frienddata corresponding to the first user identity includes at least onesecond user identity, or “subscribed” data or “focused” datacorresponding to the first user identity includes at least one seconduser identity. The indirect association is specifically that userassociated data corresponding to the first user identity does notinclude at least one second user identity; there may be at least onetype of same attribute information between the first user identity andthe at least one second user identity; the attribute informationincludes but is not limited to at least one of the followinginformation: geographical information, user label information (hobbyattribute information, personality attribute information, and the like),and the like. The attribute information may also be specifically anassociated user identity. Namely, friend data corresponding to the firstuser identity and friend data corresponding to at least one second useridentity include at least one same user identity, namely, there is atleast one same friend between the first user and the at least one seconduser.

In this embodiment, the first data packet provides a specific interface.The specific interface supports being called by the outside. Forexample, when two terminals both load and run the first data packet,after loaded and run, the first data packet of the first terminal maycall a specific interface of the first data packet of the secondterminal, to obtain target object data corresponding to the second useridentity in the second data packet. Namely, the first data packet has acalling capability open to the outside.

In this embodiment, during running of the application program anddrawing of the first image layer corresponding to the display content ofthe application program, the second image layer including the firsttarget object corresponding to the first user identity and the secondtarget object corresponding to the second user identity is drawn basedon the run first data packet, and the target object data that isobtained based on the specific interface, data of the first targetobject corresponding to the first user identity being preconfigured inthe first data packet; the first data packet may include data of atleast one first target object; the target object data obtained based onthe specific interface may include data of at least one second targetobject separately corresponding to any second user identity; namely,during drawing of the second image layer including the first targetobject and the second target object, the second image layer may includeat least one first target object and at least one second target object.During actual application, the second image layer may be rendered in amanner of an OpenGL, so that the second image layer has a specificdisplay attribute. The specific display attribute is, for example, atransparent background and foreground customizable content, namely, aforeground customization target object. Areas other than the targetobject (including the first target object and the second target object)are set to a transparent display attribute, so that when the secondimage layer covers the first image layer, the first target object andthe second target object are presented and fused in display content ofthe application program, and areas other than the areas covered by thefirst target object and the second target object in the display contentof the application program can be browsed by a user through the firstimage layer in the transparent display attribute. The first targetobject and the second target object may be both three-dimensionalobjects. Namely, after the second image layer is rendered, a user maysee a target object having a three-dimensional effect.

During actual application, a to-be-output image may include a pluralityof layers during image drawing. Each layer may include differentelements in the image. For example, an image layer including backgroundimage data may be disposed on a bottom image layer, and other elementsother than the background image data in the image data may be disposedon other image layers other than a top image layer and the bottom imagelayer according to an actual requirement. The second image layer in thisembodiment may be disposed on a top layer. The first image layer in thisembodiment may include other image layers other than the top imagelayer. A configuration parameter of each image layer may be configured.A location of each image layer in all image layers may be determinedbased on the configuration parameter. In an actual drawing process,relative layer locations of the image layers may be formatted based onconfiguration parameters carried in the image layers, and then imagedata in the image layer is drawn.

In this embodiment, the detecting an operation includes: detecting ascreen operation based on a touch sensing assembly, or detecting aninput operation based on an input assembly. The input assembly includesat least one of the following: a physical key, a built-in keyboard, anexternal keyboard, a mouse, and other data input devices. In animplementation, when the terminal device is a terminal device of a typesuch as a mobile phone or a tablet computer having a touch sensingscreen, a screen operation may be detected through the touch sensingscreen. In another implementation, when the terminal device is aterminal device of a type such as a mobile phone having a physical keyor a computer having a keyboard and/or a mouse, an input operation maybe detected through a data input device such as a physical key, akeyboard, or a mouse. Further, determining whether the operation is thefirst operation for the target object includes: obtaining locationinformation of the operation, and obtaining relative locationinformation of the target object; and calculating an offset distancebetween the location information and the relative location information,and determining that the operation is the first operation for the targetobject when the offset distance does not reach a preset threshold.

In an implementation, when a screen operation is detected, it isdetected whether the screen operation is a first operation for the firsttarget object. Target object data corresponding to the first targetobject includes relative location information. The relative locationinformation may represent a location of the current first target objectin a display screen. During actual application, the relative locationinformation may be indicated through coordinate information in which thedisplay screen is a coordinate plane. An operation location of thescreen operation is detected through a touch sensing assembly, and iscompared with the relative location information of the first targetobject for calculation, to obtain an offset distance between theoperation location and the relative location information. When theoffset distance does not reach a preset threshold, it may be determinedthat the operation location matches the relative location information,namely, it is determined that the screen operation is for the firsttarget object, and it is detected that the screen operation is the firstoperation for the first target object. During actual application, basedon the second image layer located on the top layer, the screen operationmay be detected by the first data packet, and it is determined whetherthe screen operation is the first operation for the first target object.In other implementations, the screen operation may also be detected byan operating system, and the operating system determines whether thescreen operation is the first operation for the target object.

In another implementation, when an input operation is detected, it isdetected whether the input operation is a first operation for the firsttarget object. After the first data packet is loaded, an input interfacethat can receive a view layer is provided. An input operation of a datainput device may be first detected by the view layer, and locationinformation of the input operation in the view layer is obtained.Location information of the input operation in the view layer isobtained through the input interface provided after the first datapacket is loaded. Target object data corresponding to the first targetobject includes relative location information. The relative locationinformation may represent a location of the current first target objectin a display screen. During actual application, the relative locationinformation may be indicated through coordinate information in which adisplay screen is a coordinate plane. The location information of theinput operation in the view layer is compared with the relative locationinformation of the first target object for calculation, to obtain anoffset distance between the location information of the input operationin the view layer and the relative location information. When the offsetdistance does not reach a preset threshold, it may be determined thatthe location information of the input operation in the view layermatches the relative location information, namely, it is determined thatthe input operation is for the first target object, and it is detectedthat the input operation is the first operation for the first targetobject.

In this embodiment, when it is determined that the operation is thefirst operation for the first target object, a first operationinstruction is generated and executed based on the first data packet. Inan implementation, when the operating system detects the firstoperation, a target object event corresponding to the first operation isgenerated and the first data packet is notified. In anotherimplementation, based on the second image layer located on the toplayer, the first data packet may directly detect the first operation. Atleast one group of operations and corresponding operation instructionsare preconfigured in the first data packet. When the first operation isdetected, namely, when a target object event corresponding to the firstoperation is received, the first operation instruction corresponding tothe first operation is obtained and executed. The first operationinstruction is used to control the first target object to execute acorresponding action. The action is, for example, an action such asmovement or jumping. When the first target object is presented as athree-dimensional avatar object, the action may also be an action thatcontrols four limbs of the three-dimensional avatar object, and/or, thatcontrols facial expression changes of the three-dimensional avatarobject.

In an implementation, the method may further include: when the operationis a second operation for a virtual object other than the first targetobject and the second target object, generating and executing a secondoperation instruction based on the application program to respond to theapplication program.

In this implementation, when it is determined that the operation is asecond operation for other virtual objects other than the target object(including the first target object and the second target object),namely, the operation is not for the first target object or the secondtarget object, namely, areas other than the target object (including thefirst target object and the second target object) in the first imagelayer have a transparent display attribute, so that the operation is forthe virtual object included in the application program rendered in thefirst image layer, in an implementation, the operating system detectsthe second operation, and an application program event corresponding tothe second operation is generated based on an identification result thatthe second operation is not for the target object, and the applicationprogram event is notified to the application program. In anotherimplementation, the first data packet detects a second operation, and anapplication program event corresponding to the second operation isgenerated based on an identification result that the second operation isnot for the target object, and the application program event is notifiedto the application program, so that the application program generatesand executes a second operation instruction according to the applicationprogram event of the second operation, and the second operationinstruction is used to respond to the application program.

An example in this embodiment may be shown in FIG. 3d . FIG. 3d shows ascenario of a game type application program. FIG. 3d shows a scenario ofa game type application that may include at least two virtualthree-dimensional avatar objects. One of the at least two virtualthree-dimensional avatar objects is a first virtual three-dimensionalavatar object corresponding to a terminal user (FIG. 3d shows a femalevirtual three-dimensional avatar object). The first virtualthree-dimensional avatar object supports receiving an input operation ofthe terminal and executing a corresponding action. The virtualthree-dimensional avatar object other than the first virtualthree-dimensional avatar object in the at least two virtualthree-dimensional avatar objects (for example, FIG. 3d shows a malevirtual three-dimensional avatar object) is a virtual three-dimensionalavatar object corresponding to another terminal user having anassociation (the association, for example, may be a friendship,“subscribed’ relationship, or “focused” relationship) with the terminaluser. The terminal user may interact with the another terminalcorresponding to the another terminal user through the first virtualthree-dimensional avatar object. The interaction may be an actioninteraction between virtual three-dimensional avatar objects. The actioninteraction, for example, is a waving action, a handshake action, atouch action, or the like. The interaction may also be informationinteraction based on virtual three-dimensional avatar objects. Forexample, a terminal user inputs a plurality pieces of text and sends thetext through one piece of information. In an example, the informationmay also be output in an image. Specifically, for example, theinformation is output on a head top of the first virtualthree-dimensional avatar object corresponding to the terminal user in amanner of a short-cut menu. In another example, the information may alsobe converted into voice data for output. The another terminalcorresponding to the another virtual three-dimensional avatar objectreceives the information. In an example, the information may be outputand displayed in a display interface of the another terminal. Forexample, the information is displayed on a head top of the first virtualthree-dimensional avatar object in the display interface of the anotherterminal in a manner of a short-cut menu. In another example, theinformation may also be converted into voice data for output so that theanother user terminal can hear it.

By using the technical solution of this embodiment of this application,the obtained first data packet is loaded during running of theapplication program, and the second image layer that includes the targetobject and that is drawn based on the loading of the first data packetis covered on the first image layer drawn based on the running of theapplication program, so that a display effect that the target object isfused with the display content of the application program isimplemented. In addition, the fused display content supports useroperations, thereby implementing smooth communication between the targetobject and the display content of the application program. According toa second aspect, the first data packet provides a specific interfacesupporting calling, to implement interaction between target objectshaving an association there between, thereby greatly improving operationexperience of users. According to a third aspect, the first data packetis independent of the application program, so that the first data packetcan be developed by a dedicated development group, and a user does notneed to learn a development principle of the target object, and thetarget object fused with the display content of the application programcan be obtained by obtaining the first data packet from the networkdevice. The first data packet is developed by a professional developerof the target object, so that the development threshold and developmentcosts are greatly reduced, and development time is reduced.

Based on the descriptions of the foregoing information processing methodapplied to the first type of terminal and the second type of terminal,FIG. 7 is a schematic diagram of interaction of an informationprocessing method according to an embodiment of this application. Asshown in FIG. 7, a model upload port on the left side of a serveruploads model data, and the uploaded model is specifically the firstdata packet in the foregoing embodiment. During actual application, adeveloper may manufacture and generate model data through a terminaldevice such as a PC and upload the model data to the server through themodel upload port. Different developers may manufacture differentmodels. For example, a developer A may manufacture a model A and uploadthe model A to the server through the model upload port. A developer Bmay manufacture a model B and upload the model B to the server throughthe model upload port, and so on. A user end on the right side of theserver may be used as a user or a caller, and may obtain model data fromthe server side and load the model data during running of a specificapplication program. The model data may include at least one targetobject.

FIG. 8 is another schematic diagram of interaction of an informationprocessing method according to an embodiment of this application. Basedon FIG. 7 in combination with FIG. 8, on the side of the first type ofterminal (namely, the terminal used by the developer), standard elementresources are developed and manufactured. The standard element resourcesinclude a standard body element resource, a standard hair elementresource, a standard clothes element resource (the clothes may includetops, pants, configurations, and the like), and the like. Standardtarget object data (or may referred to as standard model data) isgenerated based on the standard element resources. During actualapplication, the target object data manufactured and generated by thedeveloper may use any file format that supports transmission of 3D modeldata, for example, a DAE format, an FBX format, or an OBJ format.

For different application scenarios, attribute parameters of at leastsome elements of the required target object need to be modifiedaccording to requirements, such as attribute parameters of elements likehair type and/or color, clothes type and/or color, or accessory typeand/or color. During actual application, a self-defined solution may beconfigured for some elements. For example, independent modificationconfiguration is performed on attribute parameters of one or severalelements, or a self-defined solution is configured to the whole targetobject, namely, modification configuration is performed on attributeparameters of the whole target object. Any one of the foregoingself-defined solutions can generate the specific first data packet(namely, model data) in a unified format, and the specific format is,for example, an FBX format. The first data packet is uploaded to aserver having a data store function.

A display interface of the data store (equivalent to a server) outputsand displays an identifier corresponding to uploaded content. It may beunderstood that the data store is equivalent to an open platform of themodel data, and a user may search in the data store for required modeldata. During actual application, to obtain required model data, the userfurther needs to pay some fees in some cases. Only after the payment iscompleted, the user can download from the data store (namely, theserver) to obtain the corresponding first data packet (namely, the modeldata).

The second type of terminal (namely, a user or a caller) side obtainsthe corresponding first data packet through the data store. For anapplication scenario, namely, when the second type of terminal has agame 3D editable tool such as Unity 3D, during running of thecorresponding game application, model data included in the first datapacket is exported, and otherwise, an information processing solution ofthis embodiment of this application may be used, to execute the firstdata packet, and the target object is fused into display content of anapplication without a 3D development capability through a 3D renderinglayer embedding solution.

An embodiment of this application further provides an informationprocessing apparatus. FIG. 9 is a first schematic structural diagram ofan information processing apparatus according to an embodiment of thisapplication. As shown in FIG. 9, the apparatus includes: a runningcircuitry 41, a drawing circuitry 42, a rendering circuitry 43, an inputcircuitry 44, and a logic control circuitry 45.

The running circuitry 41 is configured to: call and load a pre-obtainedfirst data packet during execution of a running instruction of anapplication program.

The drawing circuitry 42 is configured to: draw a second image layerincluding a target object based on the loading of the first data packetduring running of the application program by the running circuitry 41and drawing of a first image layer corresponding to the applicationprogram, a specific display attribute being configured in areas otherthan the target object in the second image layer.

The rendering circuitry 43 is configured to: render and output imagedata comprising the first image layer and the second image layer, thesecond image layer covering the first image layer.

The input circuitry 44 is configured to detect an operation.

The logic control circuitry 45 is configured to: when the operationdetected by the input circuitry 44 is a first operation for the targetobject, generate and execute a first operation instruction based on thefirst data packet to control the target object to execute acorresponding action.

In this embodiment, the logic control circuitry 45 is configured to:obtain location information of the operation detected by the inputcircuitry 44, and obtain relative location information of the targetobject; and calculate an offset distance between the locationinformation and the relative location information, and determine thatthe operation is the first operation for the target object when theoffset distance does not reach a preset threshold.

In an implementation, the logic control circuitry 45 is furtherconfigured to: when the operation detected by the input circuitry 44 isa second operation for a virtual object other than the target object,generate and execute a second operation instruction based on theapplication program to respond to the application program.

A person skilled in the art should understand that reference may be madeto the related descriptions of the foregoing information processingmethod for operations of the circuitry in the information processingapparatus in this embodiment of this application. The processingcircuitry in the information processing apparatus in this embodiment ofthis application may be implemented through an analog and/or digitalcircuit implementing the embodiment of this application, or may beimplemented through hardware or a combination of hardware and softwarethat executes the logic of this embodiment of this application on anintelligent terminal.

An embodiment of this application further provides an informationprocessing apparatus. FIG. 10 is a second schematic structural diagramof an information processing apparatus according to an embodiment ofthis application. As shown in FIG. 10, the apparatus includes: a runningcircuitry 41, a first obtaining circuitry 46, a drawing circuitry 42, arendering circuitry 43, an input circuitry 44, and a logic controlcircuitry 45.

The running circuitry 41 is configured to: call and load a pre-obtainedfirst data packet during execution of a running instruction of anapplication program.

The first obtaining circuitry 46 is configured to: obtain at least onesecond user identity associated with a first user identity correspondingto the application program; and call a specific interface to obtaintarget object data corresponding to the at least one second useridentity.

The drawing circuitry 42 is configured to draw a second image layerincluding a first target object and a second target object based on theloading of the first data packet by the running circuitry 41 and thetarget object data of the at least one second user identity that isobtained by the obtaining circuitry during running of the applicationprogram by the running circuitry 41 and drawing of a first image layercorresponding to the application program, the first target objectcorresponding to the first user identity, and the second target objectcorresponding to the second user identity, and a specific displayattribute being configured in areas other than the target object in thesecond image layer.

The rendering circuitry 43 is configured to: render and output imagedata comprising the first image layer and the second image layer, thesecond image layer covering the first image layer.

The input circuitry 44 is configured to detect an operation.

The logic control circuitry 45 is configured to: when the operationdetected by the input circuitry 44 is a first operation for the firsttarget object, generate and execute a first operation instruction basedon the first data packet to control the first target object to execute acorresponding action.

In this embodiment, the logic control circuitry 45 is configured to:obtain location information of the operation detected by the inputcircuitry 44, and obtain relative location information of the firsttarget object; and calculate an offset distance between the locationinformation and the relative location information, and determine thatthe operation is the first operation for the first target object whenthe offset distance does not reach a preset threshold.

In an implementation, the logic control circuitry 45 is furtherconfigured to: when the operation detected by the input circuitry 44 isa second operation for a virtual object other than the first targetobject and the second target object, generate and execute a secondoperation instruction based on the application program to respond to theapplication program.

A person skilled in the art should understand that reference may be madeto the related descriptions of the foregoing information processingmethod for operations of the circuitry in the information processingapparatus in this embodiment of this application. The circuitry in theinformation processing apparatus in this embodiment of this applicationmay be implemented through an analog and/or digital circuit implementingthe embodiment of this application, or may be implemented throughhardware or a combination of hardware and software that executes thelogic of this embodiment of this application on an intelligent terminal.

In this embodiment of this application, the running circuitry 41, thedrawing circuitry 42, the rendering circuitry 43, the input circuitry44, and the logic control circuitry 45 that are in the apparatus may beall implemented by a central processing circuitry (CPU), a digitalsignal processor (DSP), a microcontroller circuitry (MCU), or afield-programmable gate array (FPGA) in actual application.

Based on the information processing apparatus shown in FIG. 9 or FIG.10, an embodiment of this application further provides an informationprocessing apparatus. FIG. 11 is a schematic diagram of hardwarecomposition of an information processing apparatus according to anembodiment of this application. As shown in FIG. 11, the informationprocessing apparatus includes a memory 52, a processor 51, and acomputer program that is stored in the memory 52 and that can run on theprocessor 51. When executing the program, the processor 51 implementssteps of the information processing method in this embodiment of thisapplication. The information processing apparatus further includes anexternal communication interface 53. The processor 51, the memory 52,and the external communication interface 53 may all be connected througha bus 54. Specifically, when the processor 51 executes the program, thefollowing is implemented: calling and loading a pre-obtained first datapacket during execution of a running instruction of an applicationprogram; drawing a second image layer including a target object based onthe loading of the first data packet during running of the applicationprogram and drawing of a first image layer corresponding to theapplication program, a specific display attribute being configured inareas other than the target object in the second image layer; renderingand outputting image data including the first image layer and the secondimage layer, the second image layer covering the first image layer; andif an operation is detected, when the operation is a first operation forthe target object, generating and executing a first operationinstruction based on the first data packet to control the target objectto execute a corresponding action.

In an implementation, when the processor 51 executes the program, thefollowing is implemented: when the operation is a second operation for avirtual object other than the target object, generating and executing asecond operation instruction based on the application program to respondto the application program.

In an implementation, when the processor 51 executes the program, thefollowing is implemented: obtaining at least one second user identityassociated with a first user identity corresponding to the applicationprogram before the drawing a second image layer including a targetobject based on the loading of the first data packet; calling a specificinterface to obtain target object data corresponding to the at least onesecond user identity; drawing a second image layer including a firsttarget object and a second target object based on the loading of thefirst data packet and the target object data of the at least one seconduser identity, the first target object corresponding to the first useridentity, and the second target object corresponding to the second useridentity.

In an implementation, when the processor 51 executes the program, thefollowing is implemented: obtaining location information of theoperation, and obtaining relative location information of the targetobject; and calculating an offset distance between the locationinformation and the relative location information, and determining thatthe operation is the first operation for the target object when theoffset distance does not reach a preset threshold.

In this embodiment, the memory 52 may be implemented by any type ofvolatile or non-volatile storage device, or a combination thereof. Thenon-volatile memory may be a read only memory (ROM), a programmableread-only memory (PROM), an erasable programmable read-only memory(EPROM), an electrically erasable programmable read-only memory(EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, amagnetic surface memory, an optical disc, or a compact disc read-onlymemory (CD-ROM), and the magnetic surface memory may be a magnetic diskmemory or a magnetic tape memory. The volatile memory may be a randomaccess memory (RAM), used as an external cache. Through exemplary butnon-limitative descriptions, RAMs in lots of forms may be used, forexample, a static random access memory (SRAM), a synchronous staticrandom access memory (SSRAM), a dynamic random access memory (DRAM), asynchronous dynamic random access memory (SDRAM), a double data ratesynchronous dynamic random access memory (DDRSDRAM), an enhancedsynchronous dynamic random access memory (ESDRAM), a SyncLink dynamicrandom access memory (SLDRAM), and a direct rambus random access memory(DRRAM). The memory 52 described in this embodiment of this applicationaims to include but is not limited to these memories and any othersuitable type of memory.

The processor 51 may be an integrated circuit chip, having a capabilityof processing a signal. In an implementation process, steps in theforegoing methods can be implemented by using a hardware integratedlogical circuit in the processor 51, or by using instructions. Theprocessor 51 may be a general purpose processor, a DSP, or anotherprogrammable logic device, discrete gate or transistor logic device,discrete hardware component, or the like. The processor 51 may implementor perform the methods, the steps, and logical block diagrams that aredisclosed in the embodiments of this application. The general purposeprocessor may be a microprocessor or any conventional processor, or thelike. Steps of the methods disclosed with reference to the embodimentsof this application may be directly performed and completed by using ahardware decoding processor, or may be performed and completed by usinghardware or a combination of hardware and logic in the decodingprocessor. The software logic may be located in the storage medium. Thestorage medium is located in the memory 52. The processor 51 readsinformation in the memory 52, and completes steps of the foregoingmethod in combination with hardware thereof.

In an exemplary embodiment, the information processing apparatus may beimplemented by one or more application specific integrated circuits(ASICs), DSPs, programmable logic devices (PLDs), complex programmablelogic devices (CPLDs), FPGAs, general purpose processors, controllers,MCUs, microprocessors, or other electronic elements, for executing theforegoing method.

FIG. 12 is a schematic structural diagram of an information processingapparatus according to an embodiment of this application. As shown inFIG. 11 and FIG. 12, the apparatus includes a hardware layer 500, anoperating system layer 501, an application program that runs based onthe operating system layer, a first data packet, and a view layer 502.The hardware layer 500 may include the processor 51, the memory 52 andthe external communication interface 53 that are shown in FIG. 11.Reference may be made to the descriptions of FIG. 11 for the processor51, the memory 52, and the external communication interface 53, anddetails are not described herein again.

The operating system layer 501 includes various system programs, such asa framework layer, a kernel library layer, and a drive layer, forimplementing various basic services and processing a task based on thehardware layer 500. In this embodiment of this application, use of anoperating system of any type is not excluded, including a Linux kernelbased operating system such as the Android system, and the IOS systemand the Unix like system may also be included.

The application program is an application program that has a targetobject fusion requirement in this embodiment of this application, suchas a map type application and a game type application. The first datapacket is an SDK that includes target object data and that ispre-obtained from a network device (for example, a server to which adata store belongs). During running of the application program, theoperating system calls and loads the first data packet. The displaycontent loaded and drawn by the application program is carried throughthe first image layer in the view layer 502, and the target object drawnthrough loading of the first data packet is carried through the secondimage layer in the view layer 502.

In an implementation, when an operation is detected, an operation eventprocessing function in the first data packet identifies whether theoperation is an operation for the target object, if yes, generates acorresponding instruction to control the target object to execute acorresponding action, and if not, notifies the application program, sothat a call-back response function of the application program makes acorresponding response according to the operation, to implement smoothcommunication between the application program and the first data packet.In another implementation, the operating system layer 501 detects theoperation and identifies whether the operation is an operation for thetarget object; if yes, generates a corresponding event for notificationto the first data packet, and the first data packet generates acorresponding instruction according to the corresponding event tocontrol an action of the target object, and if not, generates acorresponding event for notification to the application program, and theapplication program generates a corresponding instruction according tothe corresponding event to make a response. On the other hand, abackground transparency processing function in the first data packetperforms transparency processing on areas other than the target objectin the second image layer, to implement seamless fusion between thetarget object and the display content of the application program.

An embodiment of this application further provides an informationprocessing apparatus. FIG. 13 is a third schematic structural diagram ofan information processing apparatus according to an embodiment of thisapplication. As shown in FIG. 13, the apparatus includes: a secondobtaining circuitry 61, a generation circuitry 62, and a communicationcircuitry 63.

The second obtaining circuitry 61 is configured to: obtain the targetobject data of the first format based on the plurality of elementresources, and obtain the configuration information of the target objectdata, the first format being any file format supporting transmission ofspecific data.

The generation circuitry 62 is configured to generate a first datapacket that meets a specific format based on the target object data andthe configuration information obtained by the second obtaining circuitry61.

The communication circuitry 63 is configured to send the first datapacket generated by the generation circuitry 62 to the network deice, sothat the terminal device obtains the first data packet from the networkdevice.

In this embodiment, the second obtaining circuitry 61 is configured to:obtain a plurality of preset standard element resources, the standardelement resources meeting the first format; perform updatingconfiguration on at least some of the plurality of standard elementresources, to obtain a plurality of element resources meeting arequirement; and obtain target object data of the first format based onthe plurality of element resources.

A person skilled in the art should understand that reference may be madeto the related descriptions of the foregoing information processingmethod for operations of the circuitry in the information processingapparatus in this embodiment of this application. The circuitry in theinformation processing apparatus in this embodiment of this applicationmay be implemented through an analog and/or digital circuit implementingthe embodiment of this application, or may be implemented throughhardware or a combination of hardware and software that executes thelogic of this embodiment of this application on an intelligent terminal.

In this embodiment of this application, the second obtaining circuitry61 and the generation circuitry 62 in the apparatus may be bothimplemented by the CPU, DSP, MCU, or FPGA in the terminal during actualapplication. The communication circuitry 63 in the apparatus may beimplemented through a communication logic (including: a basiccommunication suite, an operating system, a communication logic, astandardized interface and protocol, and the like) and a transceiverantenna during actual application.

Based on the information processing apparatus shown in FIG. 13, thisembodiment of this application further provides an informationprocessing apparatus. Reference may be made to FIG. 11 for details ofthe information processing apparatus. The information processingapparatus includes a memory, a processor, and a computer program that isstored in the memory and that can run on the processor. When executingthe program, the processor implements steps of the informationprocessing method according to this embodiment of this application.Specifically, when the processor executes the program, the following isimplemented: obtaining the target object data of the first format basedon the plurality of element resources, and obtaining the configurationinformation of the target object data, the first format being any fileformat supporting transmission of specific data; and generating a firstdata packet meeting a specific format based on the target object dataand the configuration information, and sending the first data packet toa network device, so that the terminal device obtains the first datapacket from the network device.

In an implementation, when the processor executes the program, thefollowing is implemented: obtaining a plurality of preset standardelement resources, the standard element resources meeting the firstformat; performing updating configuration on at least some of theplurality of standard element resources, to obtain a plurality ofelement resources meeting a requirement; and obtaining target objectdata of the first format based on the plurality of element resources.

An embodiment of this application further provides a computer storagemedium, storing a computer instruction. When the instruction is executedby a processor, steps of the information processing method in thisembodiment of this application are implemented. Specifically, when theinstruction is executed by the processor, the following is implemented:calling and loading a pre-obtained first data packet during execution ofa running instruction of an application program; drawing a second imagelayer including a target object based on the loading of the first datapacket during running of the application program and drawing of a firstimage layer corresponding to the application program, a specific displayattribute being configured in areas other than the target object in thesecond image layer; rendering and outputting image data including thefirst image layer and the second image layer, the second image layercovering the first image layer; and if an operation is detected, whenthe operation is a first operation for the target object, generating andexecuting a first operation instruction based on the first data packetto control the target object to execute a corresponding action.

In an implementation, when the instruction is executed by the processor,the following is implemented: when the operation is a second operationfor a virtual object other than the target object, generating andexecuting a second operation instruction based on the applicationprogram to respond to the application program.

In an implementation, when the instruction is executed by the processor,the following is implemented: obtaining at least one second useridentity associated with a first user identity corresponding to theapplication program before the drawing a second image layer including atarget object based on the loading of the first data packet; calling aspecific interface to obtain target object data corresponding to the atleast one second user identity; drawing a second image layer including afirst target object and a second target object based on the loading ofthe first data packet and the target object data of the at least onesecond user identity, the first target object corresponding to the firstuser identity, and the second target object corresponding to the seconduser identity.

In an implementation, when the instruction is executed by the processor,the following is implemented: obtaining location information of theoperation, and obtaining relative location information of the targetobject; and calculating an offset distance between the locationinformation and the relative location information, and determining thatthe operation is the first operation for the target object when theoffset distance does not reach a preset threshold.

An embodiment of this application further provides a computer storagemedium, storing a computer instruction. When the instruction is executedby a processor, steps of the information processing method in thisembodiment of this application are implemented. Specifically, when theinstruction is executed by the processor, the following is implemented:obtaining the target object data of the first format based on theplurality of element resources, and obtaining the configurationinformation of the target object data, the first format being any fileformat supporting transmission of specific data; and generating a firstdata packet meeting a specific format based on the target object dataand the configuration information, and sending the first data packet toa network device, so that the terminal device obtains the first datapacket from the network device.

In an implementation, when the instruction is executed by the processor,the following is implemented obtaining a plurality of preset standardelement resources, the standard element resources meeting the firstformat; performing updating configuration on at least some of theplurality of standard element resources, to obtain a plurality ofelement resources meeting a requirement; and obtaining target objectdata of the first format based on the plurality of element resources.

In the several embodiments provided in this application, it should beunderstood that the disclosed apparatus and method may be implemented inother manners. The described device embodiments are merely exemplary.For example, the circuitry division is merely logical function divisionand may be other division during actual implementation. For example,circuitry or components may be merged or integrated into another system,or some features may be ignored or not performed. In addition, thedisplayed or discussed mutual couplings or direct couplings orcommunication connections between the components may be implementedthrough some interfaces, indirect couplings or communication connectionsbetween the devices or circuitry, or electrical connections, mechanicalconnections, or connections in other forms.

The circuitry described as separation parts may be or may not bephysically separated. The part used as display circuitry may be or maynot be a physical circuitry. That is, the circuitry may be located inthe same place, or may be distributed to many network circuitry. Some orall of the circuitry need to be selected according to actualrequirements to implement the purpose of the solution of theembodiments.

In addition, functional circuitry in the embodiments of this applicationmay be integrated into one processing circuitry, or each of thecircuitry may exist alone physically, or two or more circuitry may beintegrated into one circuitry. The integrated circuitry may beimplemented in the form of hardware, or may be implemented in the formof hardware and logic.

Persons of ordinary skill in the art should understand that all or someof the steps of the method embodiment may be implemented by a programinstructing relevant hardware. The program may be stored in a computerreadable storage medium. When the program is run, the steps of themethod embodiment are performed. The storage medium may be any mediumthat is capable of storing program code, such as a mobile storagedevice, a ROM, a RAM, a magnetic disk, and an optical disc.

Alternatively, when the integrated logic in this application isimplemented in the form of circuitry and sold or used as an independentproduct, the integrated logic may be stored in a computer readablestorage medium. Based on such an understanding, the technical solutionsof the embodiments of this application essentially, or the partcontributing to the prior art may be implemented in a form of a product.The computer product is stored in a storage medium and includes severalinstructions for instructing a computer device (which may be a personalcomputer, a server, a network device, or the like) to perform all orsome of the methods described in the embodiments of this application.The foregoing storage medium includes: any medium that can store programcode, such as a mobile storage device, a ROM, a magnetic disk, or anoptical disc.

A second action may be said to be “in response to” a first actionindependent of whether the second action results directly or indirectlyfrom the first action. The second action may occur at a substantiallylater time than the first action and still be in response to the firstaction. Similarly, the second action may be said to be in response tothe first action even if intervening actions take place between thefirst action and the second action, and even if one or more of theintervening actions directly cause the second action to be performed.For example, a second action may be in response to a first action if thefirst action sets a flag and a third action later initiates the secondaction whenever the flag is set.

To clarify the use of and to hereby provide notice to the public, thephrases “at least one of <A>, <B>, . . . and <N>” or “at least one of<A>, <B>, . . . <N>, or combinations thereof” or “<A>, <B>, . . . and/or<N>” are defined by the Applicant in the broadest sense, superseding anyother implied definitions hereinbefore or hereinafter unless expresslyasserted by the Applicant to the contrary, to mean one or more elementsselected from the group comprising A, B, . . . and N. In other words,the phrases mean any combination of one or more of the elements A, B, .. . or N including any one element alone or the one element incombination with one or more of the other elements which may alsoinclude, in combination, additional elements not listed.

While various embodiments have been described, it will be apparent tothose of ordinary skill in the art that many more embodiments andimplementations are possible. Accordingly, the embodiments describedherein are examples, not the only possible embodiments andimplementations.

What is claimed is:
 1. A method comprising: drawing, by a terminaldevice, a first image layer corresponding to an application program;calling, by the terminal device, a first data packet concurrent withexecution of a running instruction of an application program; drawing,by the terminal device, concurrent with execution of the applicationprogram and drawing of the first image layer corresponding to theapplication program, a second image layer comprising a target objectbased on the first data packet and a preset display attribute, thepreset display attribute positioned in the second image layer separatefrom the target object in the second image layer; rendering, by theterminal device, image data comprising the first image layer and thesecond image layer, the second image layer covering the first imagelayer; detecting, by the terminal device, a first operation event forthe target object; and executing, by the terminal device, a firstoperation instruction included in the first data packet to cause thetarget object to move.
 2. The method of claim 1, wherein detecting, bythe terminal device, a first operation event for the target objectfurther comprises: detecting an input operation comprising a locationinformation, the location information corresponding to a location on thedisplay where the target object is displayed.
 3. The method of claim 1,further comprising: detecting, by the terminal device, a secondoperation event for a virtual object other than the target object;generating, by the terminal device, in response to detection of thesecond operation event, a second operation instruction operable by theapplication program; and executing, by the terminal device, the secondoperation instruction.
 4. The method of claim 3, wherein detecting, bythe terminal device, a second operation event for a virtual object otherthan the target object further comprises: detecting an input operationcomprising a location information, the location informationcorresponding to a location on the display where the target object isnot displayed.
 5. The method of claim 1, further comprising: obtaining,by the terminal device, at least one second user identifier associatedwith a first user identifier corresponding to the application programbefore drawing the second image layer; and receiving, by the terminaldevice, based on communication with a preset interface, target objectdata corresponding to the at least one second user identifier.
 6. Themethod of claim 5, wherein the target object comprises a first targetobject, wherein drawing a second image layer comprising a target objectbased on the first data packet and a preset display attribute methodfurther comprises: drawing, by the terminal device, the first targetobject and a second target object based on the first data packet and thetarget object data of the at least one second user identifier, whereinthe first target object corresponds to the first user identifier, andthe second target object corresponds to the at least one second useridentifier.
 7. The method of claim 1, wherein detecting the firstoperation event for the target object further comprises: obtaining, bythe terminal device, location information f the first operation;obtaining, by the terminal device, location information of the targetobject; calculating, by the terminal device, an offset distance betweenthe location information of the first operation event and the locationinformation of the target object; and detecting, by the terminal device,the first operation in response to the offset distance being less than apreset threshold.
 8. An apparatus comprising: a memory storing aplurality of instructions; and a processor configured to execute theplurality of instructions, and upon execution of the plurality ofinstructions, the processor is configured to: draw a first image layercorresponding to an application program; call a first data packetconcurrent with execution of a running instruction of an applicationprogram; draw, concurrent with execution of the application program anddrawing of the first image layer corresponding to the applicationprogram, a second image layer comprising a target object based on thefirst data packet and a preset display attribute, the preset displayattribute positioned in the second image layer separate from the targetobject in the second image layer; render image data comprising the firstimage layer and the second image layer, the second image layer coveringthe first image layer; detect a first operation event for the targetobject; and execute a first operation instruction included in the firstdata packet to cause the target object to move.
 9. The apparatus ofclaim 8, wherein in order to detect the first operation event for thetarget object, the processor, upon execution of the plurality ofplurality of instructions, is configured to: detect an input operationcomprising a location information, the location informationcorresponding to a location on the display where the target object isdisplayed.
 10. The apparatus of claim 8, further comprising: detect asecond operation event for a virtual object other than the targetobject; in response to detection of the second operation event, generatea second operation instruction operable by the application program; andexecute the second operation instruction.
 11. The apparatus of claim 10,wherein in order to detect the second operation event for the virtualobject other than the target object, the processor, upon execution ofthe plurality of instructions, is configured to: detect an inputoperation comprising a location information, the location informationcorresponding to a location on the display where the target object isnot displayed.
 12. The apparatus of claim 8, wherein the processor, uponexecution of the plurality of instructions, is further configured to:obtain at least one second user identifier associated with a first useridentifier corresponding to the application program before drawing thesecond image layer; and receive, based on communication with a presetinterface, target object data corresponding to the at least one seconduser identifier.
 13. The apparatus of claim 12, wherein the targetobject comprises a first target object, wherein, in order to draw thesecond image layer comprising the target object based on the first datapacket and the preset display attribute, the processor, upon executionof the plurality of instructions, is configured to: draw the firsttarget object and a second target object based on the first data packetand the target object data of the at least one second user identifier,wherein the first target object corresponds to the first useridentifier, and the second target object corresponds to the at least onesecond user identifier.
 14. The apparatus of claim 8, wherein, in orderto detect the first operation event for the target object, theprocessor, upon execution of the plurality of instructions, isconfigured to: obtain location information of the first operation;obtain location information of the target object; calculate an offsetdistance between the location information of the first operation eventand the location information of the target object; and detect the firstoperation in response to the offset distance being less than a presetthreshold.
 15. A non-transitory computer readable storage medium storinga plurality of instructions executable by a processor, the plurality ofinstructions, when executed by the processor, cause the processor to:draw a first image layer corresponding to an application program; call afirst data packet concurrent with execution of a running instruction ofan application program; draw, concurrent with execution of theapplication program and drawing of the first image layer correspondingto the application program, a second image layer comprising a targetobject based on the first data packet and a preset display attribute,the preset display attribute positioned in the second image layerseparate from the target object in the second image layer; render imagedata comprising the first image layer and the second image layer, thesecond image layer covering the first image layer; detect a firstoperation event for the target object; and execute a first operationinstruction included in the first data packet to cause the target objectto move.
 16. The non-transitory computer readable storage medium ofclaim 15, wherein in order cause the processor to detect the firstoperation event for the target object, the plurality of instructions,when executed by the processor, cause the processor to: detect an inputoperation comprising a location information, the location informationcorresponding to a location on the display where the target object isdisplayed.
 17. The non-transitory computer readable storage medium ofclaim 15, wherein the plurality of instructions, when executed by theprocessor, further cause the processor to: detect a second operationevent for a virtual object other than the target object; in response todetection of the second operation event, generate a second operationinstruction operable by the application program; and execute the secondoperation instruction.
 18. The non-transitory computer readable storagemedium of claim 17, wherein in order to cause the processor to detectthe second operation event for the virtual object other than the targetobject, the plurality of instructions, when executed by the processor,cause the processor to: detect an input operation comprising a locationinformation, the location information corresponding to a location on thedisplay where the target object is not displayed.
 19. The non-transitorycomputer readable storage medium of claim 15, wherein the plurality ofinstructions, when executed by the processor, further cause theprocessor to: obtain at least one second user identifier associated witha first user identifier corresponding to the application program beforedrawing the second image layer; and receive, based on communication witha preset interface, target object data corresponding to the at least onesecond user identifier.
 20. The non-transitory computer readable storagemedium of claim 15, wherein, in order to cause the processor to detectthe first operation event for the target object, the plurality ofinstructions, when executed by the processor, cause the processor to:obtain location information of the first operation; obtain locationinformation of the target object; calculate an offset distance betweenthe location information of the first operation event and the locationinformation of the target object; and detect the first operation inresponse to the offset distance being less than a preset threshold.